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Introduction 

This is the first book of examples from the Theory of Probability. This topic is not my favourite, 
however, thanks to my former colleague, Ole J0rsboe, I somehow managed to get an idea of what it is 
all about. The way I have treated the topic will often diverge from the more professional treatment. 
On the other hand, it will probably also be closer to the way of thinking which is more common among 
many readers, because I also had to start from scratch. 

Unfortunately errors cannot be avoided in a first edition of a work of this type. However, the author 
has tried to put them on a minimum, hoping that the reader will meet with sympathy the errors 
which do occur in the text. 

Leif Mejlbro 
25th October 2009 
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1 Some theoretical background 



It is not the purpose here to produce a full introduction into the theory, so we shall be content just 
to mention the most important concepts and theorems. 

The topic probability is relying on the concept a-algebra. A a-algebra is defined as a collection T of 
subsets from a given set fi, for which 

1) The empty set belongs to the a-algebra, e T . 

2) If a set A e T, then also its complementary set lies in T, thus ZA e T. 

3) If the elements of a finite or countable sequence of subsets of ft all lie in T ', i.e. A n e T for e.g. 
n € N, then the union of them will also belong to T, i.e. 

[JA^T. 

The sets of T are called events. 

We next introduce a probability measure on (Q, T) as a set function P : T — > K, for which 

1) Whenever AeF, then < P(A) < 1. 

2) P(0) = and P(fi) = 1. 

3) If (A n ) is a finite or countable family of mutually disjoint events, e.g. A n Aj — 0, if i ^ j, then 



LK =£m.: 



All these concepts are united in the Probability field, which is a triple (Q,F, P), where f 
empty) set, J 7 is a er-algebra of subsets of fi, and P is a probability measure on (Q,F). 

We mention the following simple rules of calculations: 

If (n,T, P) is a probability field, and A, B € T, then 

1) P(B) = P(A) + P(B\)>P(A), if AC P. 

2) P(A U B) = P(A) + P(B) - P(A n P). 

3) P((Ll) = l-P(A). 

4) H ill C A 2 C • • • C A n C • • • and A = |J A„, then P(A) = lim P (A n ) . 

n=l 

5) If A x D A 2 2 • • • 2 A n 2 • • • and A = Q A n , then P(A) = lim P (A„) . 
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Let (il, J 7 , P) be a probability field, and let A and B £ T be events where 
We define the conditional probability of A, for given B by 

In this case, Q, given by 

Q(A):=P(A\B), AeJ, 

is also a probability measure on (ft, T). 
The multiplication theorem of probability. 

P(An B) = P(B)-P(A\ B). 
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Two events A and B are called independent, if P(A \ B) = P{A), i.e. if 

P(A n B) = P{A)-P{B). 

We expand this by saying that n events Aj, j = 1, . . . , n, are independent, if we for any subset 
J C {1, . . . , 7i } have that 



We finally mention two results, which will become useful in the examples to come: 

Given (fi,.F, P) a probability field. We assume that we have a splitting (Aj) + ^ of £1 into events 
Aj e T . which means that the Aj are mutually disjoint and their union is all of O, thus 

M Aj = SI, and A; n Aj = 0, for every pair of indices (i,j), where i ^ j. 

If A <G T is an event, for which P(A) > 0, then 
The law of total probability, 

P(A) = Y / P(A J )-P(A\A J ), 
Bayes's formula, 
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2 Set theory 

Example 2.1 Let A\, A 2 , . . . , A n be subsets of the sets O. Prove that 



These formulas are called de Morgan's formulae. 



la. If x e C (U"=i -^»)) then x does not belong to any A,, thus ;r G CA for every i, and therefore also 
in the intersection, so 

lb. On the other hand, if x G P|"=i C-A», then x lies in all complements CAj, so x does not belong to 
any Aj, and therefore not in the union either, so 



t=l \t=l / 



Summing up we conclude that we have equality. 
2. If we put Bi = ZA h then ZBi = CCA, = A h and it follows from (1) that 

Then by taking the complements, 

y csi=c (n Bi ) 

We see that (2) follows, when we replace Bi by A- 

Example 2.2 Let A and B be two subsets of the set tt. We define the symmetric set difference AAB 
by 

AAB=(A\B)U(B\A). 
Prove that 

AAB = (AuB)\(AnB). 
Then let A, B and C be three subsets of the set fi. Prove that 

(AAB)AC = AA(BAC). 
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The claim is easiest to prove by a Venn diagram. Alternatively one may argue as follows: 

la. If x e (A \ B) U (B \ A), then x cither lies in A, and not in B, or in B and not in A. This means 
that x lies in one of the sets A and B, but not in both of them, hence 

AAB = (A \ B) U (B \ A) g (A U B) \ (A n B). 

lb. Conversely, if x <G (A U B) \ (A n B), and A^B, then x must lie in one of the sets, because 
x e AU B and not in both of them, since x £ A n B, hence 

(AUB)\(4nB)g(4\B)U(B\,4) = AAB. 

lc. Finally, if A — B, then it is trivial that 

AAB = (A \ B) U (B \ A) = = (A U B) \ (A n B). 

Summing up we get 

AAB = (i\B)U(B\A) = (4uB)\(4n B). 



2. If x € AAB, then x either lies in A or in B, and not in both of them. Then we have to check two 
possibilities: 

(a) If x e (AAB) AC and x g (AAB), then x does not belong to C, and precisely to one of the 
sets A and B, so we even have with equality that 



{(AAB)AC*} n (AAB) = (A \ (B U V)) U (B \ (A U C)). 
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Figure 2: Venn diagram of three discs A, B, C. The set (AAB)AC is the union of the domains in 
which we have put one of the letters A, B, C and D. 



(b) If instead x £ (AAB)AC and x € C, then x does not belong to AAB, so either x does not 
belong to any A, B, or x belongs to both sets, so we obtain with equality, 

{(AAB) AC} nC = {C\(AuB)}U{AuBUC}. 

Summing up we get 



(AAB)AC 



(A\(BUC)) 
U{B\(AuC)) 
U(C\(AUB)) 

u(AnBnC) 



By interchanging the letters we get the s 
(AAB)AC = AA(BAC). 



only contained in A, 
only contained in B, 
only contained in C, 
contained in all three sets. 

right hand side for AA(BAC), hence 
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3 Sampling with and without replacement 

Example 3.1 There are 10 different pairs of shoes in a wardrobe. Choose 4 shoes by chance. Find 
the probability of the event that there is at least one pair among them. 



First note that there are all together 20 shoes, from which we can choose 4 shoes in I I differer 

We shall below give two correct and one false solution. The first (correct) solution is even given i 
two variants. 

1) Take the complements, i.e. we apply that 

P{at least one pair} = 1 — P{no pair}. 

First variant. 

20 
First choice: 20 possibilities among 20 shoes: — , 

is 



Second choice: 18 possibilities of 19 shoes: 
Third choice: 16 possibilities of 18 shoes: 
Fourth choice: 14 possibilities of 17 shoes: 



10 



(1 pair not allowed), 
(2 pairs not allowed), 
(3 pairs not allowed). 
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Summing up, 

20 18 16 14 16- 14 224 
F{nOpair} =20-19'l8-17 = 197T7 = 323' 

hence 

224 99 

Pjat least one pair) = 1 = . 

1 l S 323 323 

Second variant. The four shoes stem from 4 pairs, where 

• we can choose 4 pairs in I ) ways. 

Within each pair (thus 4 times) one can choose 1 shoe in I J = 2 ways. 

Then 



.(?)■ 



PJ . , 10 • 9 • 8 • 7 „ 4 L2 

P{no pair} 



20 -19 -18 -17 323' 



Finally. 



2) Direct computation. 

The set of 4 shoes can contain 0, 1 or 2 pairs, hence 

P{at least one pair} = Pjprecisely one pair} + Pjprecisely two pairs}. 
We compute separately the two probabilities on the right hand side. 
(a) P{prcciscly one pair}. 

The pair can be chosen in I J = 10 ways. This is done by drawing twice, so we still have 

to draw another two times. 

Then, among the remaining pairs we can choose two in I I ways. 

Within the latter two pairs we choose 1 shoe in I ) = 2 ways. Thus 

io. f 9 y* 

Dr . , . ! V 2 J in a 9 ' 8 1-2-3-4 96 

P{pre C1 sely one pa ir } = = 10 • 4 • — • 2Q , 1Q , lg , 1? = ^ • 
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(b) imprecisely two pairs}. 

Two pairs can be chosen in f J ways. Hence 

/10\ 

• , ■ i V 2 / 10-9 1-2-3-4 3 

iNiiiveiselv two pairs f = -) (- = — — — • — - — — — — = — — -. 

xy y y s ( 20 \ 1 • 2 20 • 19 • 18 • 17 323 

Summing up it follows by an addition that 

96 3 99 

P{at least one pair} =— + — = —. 

3) Wrong argument. The following is a frequently occurring wrong argument: 



'(?). 



„ 10 l 2 ; 102 

P{at least one parr} = - = — ^ ^ . 

The error is that the possibility "two pairs of shoes" is counted twice by this procedure. 

Example 3.2 There are n different pairs of shoes in a wardrobe. Choose by chance 1r shoes, where 
2r <n. Find 

1) the probability of the event that there is no pair chosen, 

2) the probability that there is precisely one pair among them. 

( 2n \ 
We have in total 2n shoes, so we have I J possibilities. 

If we introduce the notation 

nW=n-(n-l)-(n-p+l) 
of p decreasing factors, then 

{ 2r ) (2r)I ' 

1) In this case the 2r shoes must come from 2r pairs. These 2r pair can be chosen in I J ways. 

(1 



Within each pair we can choose 1 shoe in I ) = 2 ways (in total 2r). Hence 



n (2r) . 2 2r 

/2n\ =^ny^V 



Download free eBooks at bookboon.com 



Introduction to Probability 



3. Sampling with and without replacement 



2) The pair can be chosen in ) — n ways, where we must use two draws. 

Wc still have n — 1 pairs left, of which we choose 2r — 2 in I I ways. 

We choose within each of the latter pairs 1 shoe in I J = 2 ways, in total 2r — 2 ways. Hence 

U { 2r - 2 J ' ^^ _ n^-i) . 2 2r ~ 2 



Pjprecisely one pair} = 



0") 



(2n)W 




/»1SB^ v 
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Example 3.3 There are 12 parking places in a line on a parking space. To a given time 4 of the 
places are free. Find the probability that these 4 places are successive in the line. 
Answer the came question when the 12 parking spaces are lying in a circle. 

The 4 places can be chosen in I ) = 495 ways. 

We have 9 successes, 

(1,2,3,4), (2,3,4,5), ... , (9,10,11,12), 
hence 

P x {4 s 



If the 12 parking spaces are placed in a circle, then we have the following 12 successes, 

(1,2,3,4), ... , (9,10,11,12), (10,11,12,1), (11,12,1,2), (12,1,2,3). 
Consequently, 

12 4 

P 2 {4 successive places} = — = — . 
21 y s 495 165 



Example 3.4 We assume that the 5 digits of a car number are chosen randomly and independent of 
each other. 

1. Find the probability that there are 5 different digits. 

2. Find the probability that there are precisely J dig/Is. 

3. Find the probability that all 5 digits are equal. 

la. The same as (1) with the exception that the first digit must not be 0. 

If is allowed as the first digit, we have all together 10 5 possibilities. 

1. All digits can be different in 10 • 9 • 8 • 7 • 6 ways, hence 

10 -9 -8 -7- 6 
Vi = W5 « 0.3024. 



The positions of two equal digits can be chosen in I ) = 10 ways. 

The common digit can be chosen in 10 ways. 

The remaining three digits can be chosen in 9 • 8 • 7 ways, hence 
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3. There axe only 10 ways, hence 

P3= ^=0.0001. 

la. If the first digit cannot be 0, we get 9-10 4 possibilities. Furthermore, if we shall find the probability 
of that the 5 digits are different, then we have 9 possibilities for the first place, and 9 — 1 + 1=9 
possibilities for the second place (because we now can allow 0) . For the remaining three places we 
get 8-7-6, hence 



9-10 4 
which is the same result as in (1). 

Example 3.5 Let n > 3. We randomly choose from the numbers I, 2, 3, . . . , n, in a sequen 
(without replacing the numbers), until they have all been taken. 

1) Find the probability that the numbers 1 and 2 are chosen successively in the given order. 

2) Find the probability that the numbers 1, 2 and 3 are chosen successively in the given order. 

We have several possibilities of solutions, of which we only give one. 
First notice that the n numbers can be chosen in 
n\ different orders. 

Then assume that the numbers 1 and 2 are chosen successively (in the given order). In this way \ 

"fix" two places, so we have in reality only n — 1 places to our disposition, hence 1 we have 

(n— 1)! possibilities. 
Analogously, 

(n — 2)! possibilities, 
if we assume that 1, 2, 3 are chosen in the given order. 
Summing up, 

1) P{(1,2) in the given order} = — ( - = -. 

2) P{(1, 2, 3) in the given order} = ^—^ = l 
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Example 3.6 A man has n matches, which he breaks into a short and a long piece. He collects the 
2n pieces at random in n pairs. 

Find the probability that each pair is consisting of a short and a long piece, and find in particular the 
probability in the case n — 5. 

When he breaks all matches he gets in total 2n pieces, of which n are long and the remaining n are 

short. From these 2n pieces he successively picks them up one by one, giving (2n)! possible ordered 

strings. 

Let us now consider the successes. 

The first piece can be chosen in 2n ways. 

The next piece much be chosen from the n "complementary" pieces, giving n possibilities. 

Since we have already chosen two pieces, the third piece can be chosen in 2n — 2 ways. 

The fourth piece must be chosen among the remaining n — 1 "complementary" pieces. 

We continue in this way, so we end with 

{2n-n} ■ {(2n~2) ■ (n-l)}---{2-l} = 2 n ■ (n!) 2 

successes. 
Summing up we get 



In particular, 

2 5 _ 32 • 1 ■ 2 • 3 • 4 ■ 5 
P5 ~ / 10 \ ~ 10-9-8-7-6 " 



Example 3.7 A lift starts with 7 passengers and it stops at 10 storeys. Find the probability that the 
passengers get off the lift at 7 different storeys. We assume that each passenger has the probability 
1/10 to get off at any given storey and that the storeys at which each passenger are independent of 
each other. 

The total number of possibilities is 10 7 . 

The total number of successes is 10 • 9 • 8 • 7 • 6 • 5 • 4. 

Hence 

10 -9- 8-7-6. 5-4 / 10 \ 7! 



P{7 different storeys} = - 



10 7 
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4 Playing cards 

Example 4.1 Playing bridge North has no ace. Find the probability that South has precisely 2 aces. 

North has 13 cards, none of then an ace. 

Wc shall deal 4 aces and 35 other cards among the three remaining players. 

Since South must have two aces and 11 other cards, we have 



P{South has 2 aces} = 
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Example 4.2 Playing bridge, one of the pairs of partners has in total 9 hearts. Find the probability 
that the remaining 4 hearts among the other pair of partners is distributed as follows 

1) 2 to each, 

2) 1 to one of them and 3 to the other one, 

3) 4 to the same player. 

This example can be solved in many ways. We give three variants. 
First variant. The two players have in total 26 cards, of which 4 are hearts. 
1) P{2-2}: 

a) The 26 cards are distributed in two talons of 13 cards each in I I ways. 

b) The 22 cards which are not heart can be distributed in two talons of 11 in each of them in 



11 



| ways. 



| ways. 
Summing up, 



pro ot _ V 2 / V n / _« 22! 13!13! 6 -13 -12 -13 -12 234 

F \ 2 ~ 2 I - / OR \ ~ 6 ' 



(3) 



11111! 26! 26 -25 -24 -23 575' 



2) P{3-1}: 

a) As above we get I J ways. 

b) The 22 cards which are not hearts are distributed in two talons of 10 i: 
12 in the other one in 



;s)- 



c) The 4 hearts are distributed in two talons of 3 in one of them and 1 in the other one in 
(4) = (4)=4ways. 

d) There are 2 partners, thus 3-1 is a short symbol for both 3-1 and 1-3. Hence, we have 2 
possibilies. 

Summing up we get 

/ 4 \ / 22 \ 

^ 1 J \ 10 J _ 1-4-22! 13113! _ 2 - 4 - 13 - 12 - 11 - 13 _ 286 
* *~ / 26 \ 10!12! 26!~~ 26 • 25 • 24 • 23 ~ 575' 
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3) P{4-0}. As in (2) wc get analogously 






a) ( 13 ) ways, 






b ) ( 9 J wa y s ' 






c) f J = 1 way, 






d) f 1 J = 2 ways. 






Summing up we get 






/ 4 \ / 22 \ 

I 1 I 9 ) 2-22! 


13113! 
26! 


2-13- 12-11 ■ 10 
26 • 25 • 24 • 23 



and the found probabilities have the sum 1. 

Second variant. The 4 hearts can be distributed on 26 places in f J ways. 

1) P{2-2}. 

The number of successes is f !? ) ( ^ ) , hence 

13 2 ■ 12 2 1 ■ 2 • 3 ■ 4 13-12-3 234 



p {2 - 2}= [XHli 



l 2 ■ 2 2 26 • 25 ■ 24 • 23 2 • 25 • 23 575 ' 



2) P{3-1}. 

Since we have a pair of partners, there are 2 I J I J successes, hence 

Pl3-n = 2 V 1 / V 3 J =2 13 13 -12 -11 1-2 -3 -4 = 2 ■ 13 ■ 11 

/ ">« ^ 1 1-2-3 26-25-24-23 25 • 23 



(?) 

3) P{4-0}. 



The number of 



P{4-0| - z, ■ 

(?) 



2- 13- 12- 11 -10 1-2-3-4 55 _ 11 

1-2-3-4 26 • 25 • 24 • 23 ~ 575 ~ 115' 
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Third variant. We chase the distribution of the hearts at S = South and N = North: 
1) P{2-2}. 

''*" 26 ~ 2' 



1. A heart is placed at S with probability - 

2. A heart is placed at S with probability — . 

3. A heart is placed at N with the probability - 

12 

4. A heart is placed at N with probability — . 



S and N can be chosen in I ) = 6 ways, thus 

P { 2-2} = 6.i.^.^ = ^. 
x s 2 25 24 23 575 

2) Analogously 

P{3 ~ 1} = 2 ( 3J'2'25'24'23 = 575' 

3) Finally, and also analogously, 

P|4-0|-2(' 4 V--------- - — 



Example 4.3 Assume that North and South together have 10 trumps. Find the probability that the 
remaining 3 trumps either all are at East or all are at West. 

East and West have 26 cards together, of which 3 are trumps. 
When we consider the distribution we get 



P{East has all three trumps} = 



By symmetry, this is also the probability for West having all three trumps. 
Hence. 
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Example 4.4 By a dealing the 52 cards are taken one by one. Find the probability that the foi 
are succeeding each other. 



We can choose 4 positions out of 52 possibilities in 



(?)' 



We see that 4 in a row: (1,2,3,4), (2,3,4,5), ... , (49,50,51,52), can occur 49 times. 

Thru 



Example 4.5 Find the probability that each of the 4 bridge players get precisely one ace. 
Find the probability in 7 games that at least one of these 7 games have this uniform distribution of 
the aces, and find also the probability that precisely one of the 7 games has this uniform distribution 
of the aces. 

First note that 52 cards can be distributed between 4 players with 13 cards to each in 
52! 



t's only an 
)pportunity if 
/ou act on it 




IKEA.SE/STUDENT 
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If we assume that each player has precisely one ace and 12 other cards, this can be done ii 



12! 12! 12! 12! J "' 
Then we derive the probability of each player having one ace, 

= 4!48!(13!) 4 = 24 ■ 13 4 = 13 3 = 
P (12!) 4 52! 52 -51 -50 -49 49-25-17 ' °' 

Then 

Pjnone of the 7 games has this uniform distribution of the aces} = (1 — p) 7 = 0.4582, 
hence 

P{at least one of the 7 games has the uniform distribution} = 1 — (1 — p) 7 = 0.5418. 
Finally, 

imprecisely 1 of the 7 games has this uniform distribution} = 7 • p{\ — p) 6 = 0.3783. 



Alternatively one may consider 52 places divided into 4 blocks of 13 in each of them. 

The 4 aces should be placed in given 4 of the 52 places, which gives the total number of possibilities, 



Then consider the distribution of the aces between the blocks. 

The distribution 1-1-1-1. 

We choose in each block precisely 1 of the 13 places, so the number of possibilities is 

hence, 

i "- P "- 1 - 1 - 1 »-| = 52.^.4 9 ' - 1055 - 

The distribution 2-1-1-0. 

The block that should contain 2 aces is chosen among the 4 blocks. It remains 3 possibilities for 

choosing the block, which does not contain any ace. This gives the following number of possibilities, 



»-*-*{»)(»)'(»)-*-*-™™, 



hence 

p 2 = P{2 - 1 - 1 - 0} = 9 — = 0.5843. 



Download free eBooks at bookboon.com 



Introduction to Probability 



The distribution 2-2-0-0. 
miber of si 



■(?)"■ 



p 3 = P{2 - 2 - - 0} = Zi = 0.1348. 



The distribution 3-1-0-0. 
imber of si 



Pi = P{3 - 1 - - 0} = — = 0.1648. 



The distribution 4-0-0-0. 
miber of si 



hence the probability becomes 

p 5 = P{A - - - 0} = — = 0.0106. 



Control. It follows that 

P1+P2+P3+P4+P5 = 0.1055 + 0.5843 + 0.1348 + 0.1648 + 0.0106= 1.0000. 



Example 4.6 Find the probability that North in a game of bridge gets 4 aces. Find the smallest 
number of games n, for which the probability of North having 4 aces in at least one of the n games is 
bigger than - . 



out hands. 



/4\ / 48 \ 
The successes are characterized by 4 aces and 9 other cards, so there are I ) • I ) 

Thus, the probability for North obtaining 4 aces in one game is 



successes. 



48! 13! 39! 
= 52! 39! 9! 



13 -12 -11 -10 
52 • 51 • 50 • 49 = 



■17-5 4165 
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Hence by the complementary, 

P{N does not obtain 4 aces in a game} = 1 - 



4165 4165 



P{N never obtains 4 aces in n games} = 0.997359™. 
This probability is < -, when 

n-ln0-997359<-ln2 (< 0), 
i.e. when 

"> 1=359 = 267 ' 10 ' 

We conclude that the smallest possible n is 263. 

Remark 4.1 The control shows that 
= 0.4988, 

and 

41 F>A\ 262 

= 0.5001. 



/4154\ 
I 4165 ) 



/4154 V' 
I 4165 J 
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5 Miscellaneous 

Example 5.1 Find the probability of the event that the birthdays of 6 randomly chosen persons are 
distributed in precisely 2 months (i.e. such that precisely 10 of the months do not contain any birthday.) 
We assume that every month can be chosen with the same probability. 

The 6 birthdays can be distributed in 12 6 ways on the 12 months. 

The 2 months can be chosen in I ) = 66 ways. 

The 6 birthdays can be distributed in 2 6 = 64 ways inside the 2 months where, however, 2 ways are 
not allowed, because we do not permit that all anniversaries lie only lie in 1 month. Hence we obtain 
64 - 2 = 62 ways. 

As a conclusion the probability becomes 

66-62 11-31 341 
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Alternatively we may apply the following tedious argument: 

The probability of the first two persons having their birthdays in different months, while the remaining 
four persons have their birthdays in the thus determined months is 



12 11 / 2 \ 4 _ 11 1 
12 12 ' \Y2J ~ 12 ' ¥' 



The probability that the first two persons have their birthdays in the same month, the third person 
in a different month and the remaining three persons in the thus determined months is 



The probability that the first three persons have their birthdays in the same month, the fourth person 
in a different month, while the remaining two persons have their birthdays in the thus determined 

months is 



The probability that the first four have their birthdays in the same month, the fifth person in a 
different month, while the remaining person has his birthday in one of the thus determined months is 



L \ 3 11 2 
2/ 12 ' 12' 



month, while the remaining 



The probability that the first five persons have their birthdays in the s 
person has his birthday in any other month is 

\12J 12 
The searched probability is obtained by addition, 

11 (iX jl ii (iX (l\ 2 ii (iX (iX — — f— V — - 

12 ' V12y + 12 ' 12 ' V12/ + \12/ '12 V12y + V.12 ) ' 12 ' 12 + v 12 ) ' 12 ~~ 
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Example 5.2 dc Merc's paradox. 

1) Four dices are thrown once. Find the probability that we obtain at least one six. 

2) Now, perform 2^ throws with 2 dices. Find the probability that at least one of the 24 throws results 

2 
A French gambler, Chevalier de Mere, believed that these two probabilities should be equal to — , so he 

lost a lot of money on betting on this. 

Whenever one of the phrases "at least" or ''at most" occurs it is usually easier to consider the com- 
plementary event. 

1) We get from 



P 4 {at least one six} - 1 - P 4 {no sixes} = l-(-) = 1 - — = — « 0.518. 
\ 6 / 



1296 1296 



2) In the same way we get 

P 24 {no double sixes} = g) , 

hence 

( 35 \ 24 
P 24 {at least one double sixes} = 1 - P 24 {no double sixes} = 1-1 — 1 ss 0.491. 

It follows immediately that the two probabilities are different. 

Remark 5.1 The result can also be computed directly. We shall show this on (1), in which case 
P 4 {at least one six} 

= P 4 {first six in throw number 1} + P 4 {first six in throw number 2} 

+P 4 {first six in throw number 3} + P 4 {first six in throw number 4} 
671 
1296' 



_ 1 5 1 /5\ 2 1 /5\ 3 1 _ 
" 6 + 6 ' 6 + \<a) ' 6 + \6J ' 6 ~ 1 
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Example 5.3 Spreading of r. 
In a town of n + 1 inhabitants one person is telling a rumour to another one, who tells the story to 
another one etc.. At each step the rumour-monger randomly chooses the person who he or she is going 
to tell the 



1) Find the probability of that the romour is told r times without returning to the person who started 
gossiping. 

2) Find the probability that the rumour is told r times, where r < n, without returning to anyone who 
has already received the rumour. 

It is here allowed that the rumour can also be told to the person who has just told it to himself, cf. 
Example 5.4. 

1) The first person cannot tell the story to himself, so when r = 1, the probability is 1. 
The following persons have n — I choices of n possibilities, thus the probability is 



and we see that the formula is trivial for r = 1, hence it is valid for all r £ N. 

2) The first person can choose between n persons, the second one between n— 1 persons, etc.. Person 
number j has n + 1 — j possible successful choices. Hence, if r < n, the probability is 

_n n-1 n-2 n + l-r _ (n-1)! 1 



Example 5.4 Compute (1) and (2) of Example 5.3, by assuming that a rumour-monger never 
chooses to tell the rumour to the same person who just told it to himself. 

1) Just like in Example 5.3 the probability is 1 for r = 1. 

When r > 1, the following persons have n — 2 possible successes, each of probability , because 

we have n — 1 choices, of which must be avoided. Thus we get the probability 



and hence for all r E N. We assume implicitly that n > 1. 

2) The first person can choose among n persons. 

The second person can choose among n — 1 persons, because we have to exclude the person 
(corresponding to —1) who just told the rumour. Thus 

<7i = 1 and q 2 = 1. 

The j-th person, j > 3, has n — j + 1 successes out of the n — 1 possibilities, so when r > 3, then 

_n-2 n-'i n-r + 1 _ (n-2)! 1 

qr ~ n-1 ' n- 1 n- 1 ~ (n - r)\ ' (n - l)'- 2 ' 
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Example 5.5 In a classroom there are r pupils (none of them twins). Find the probability that all 
pupils have different birthdays (we assume that all 365 days have the same probability) , and find 
approximative values of p r for reasonable small values of r. 



The probability is 






365 364 
Pr ~ 365 ' 365 


363 366 - r 
365 365 




imative values for r — 1, . . 


, 30, arc 


Px = 1,.000, 


pxx = 0.859 


P21 = 0.556 


P2 = 0.997, 


P X2 - 0.833 


p 22 = 0.524 


p 3 = 0.992, 


Pi3 = 0.806 


p 23 = 0.493 


p A = 0.984, 


pu = 0.777 


p 24 = 0.462 


P5 = 0.973, 


Pis = 0.747 


P25 = 0.431 


p 6 = 0.960, 


Pxe = 0.716 


p 26 = 0.402 


p 7 = 0.944, 


pxr = 0.685 


p 27 = 0.373 


p s = 0.026, 


Pxr = 0.653 


p 28 - 0.346 


p 9 = 0.905, 


pig = 0.621 


P29 = 0.319 


Pio = 0.883, 


p 20 = 0.589 


p 30 = 0.294 



Remark 5.2 At the first glance it may be surprisingly that when there are 23 pupils, then v 
the probability 1 — 0.493 — 0.507 that at least two pupils have the same birthday. 
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Example 5.6 Assume that there are 100 lots in a lottery and only one prize. 

What is the probability of winning the prize, when one buys two lots? 

If one instead buys one lot in each of two such lotteries, what is the probability of winning at least c 

of the two prizes? 

Give an intuitive explanation of the fact that the two probabilities are not equal. 



number of bought lots 2 
total number of lots 100 

2nd variant. 

p = Pjprize on the 1st lot} + P{loss on the 1st lot and prize on the 2nd lot} 
1 99 1 1 1 2 

Too + Too'9l3 = Too + Too = Too = °- 0200 - 

2) 1st variant. The complementary event: 

P{at least one prize} = 1 — P{no prize in 2 lotteries} 

= l-(w) =1-0.9801 = 0.0199. 

2nd variant. Direct computation, in which we identify the various possibilities: 
P{at least one prize} 

= Pjprize in the 1st lottery, loss in the 2nd lottery} 
+P{loss in the 1st lottery, prize in the 2nd lottery} 
+P{prizes in both lotteries} 
1 " " * X L 

~ Too ' Too + Too ' Too + Too ' Too ~ ' ' 

When we apply the information that the average is the same when we compare the "average prizes", 
it follows that is twice as good to obtain 2 prizes (of probability 0.0001) then just 1 prize, the average 
can only remain the same if we also lower the probability in (2), hence the probability of (2) is smaller 
than the probability of (1). 
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t are two roads from X-town to Y-town, and two roads from Y-town to Z-town. 
I X-town to Z-town one must necessarily pass through Y-town. One day there is 
vrea, and we assume that each of the four roads are closed with the probability p. 
3 that the four roads are closed independently of each other. 

Find the probability that there is an open connection from X-town to Z-town. 

A is going to drive from X-town to Z-town (without returning)- What is the probability that A is 

successful without any problems? 



Example 5.7 Th, 

In order to get fro 
a blizzard over the 
Furthermore, 




Figure 3: Graphical description of the roads between the cities. 

The probability of the event that both roads from X to Y are closed is p 2 . 

The complementary event: The probability that one can at least go by one of the roads is then 1—p 2 . 

Analogously for the roads from Y to Z. 
Then 

P{open road from X to Z} = Pjopen road from X to Y} • Pjopen road from Y to Z} = (l — p 2 ) . 

A can choose between the two roads from X to Y, each of probability - . hence 

P{A gets from X to Y} = - Pjfirst road is open} + - Pjsecond road is open} 
= l(l-p) + l(l-p) = l-p, 
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and analogously 

P{A gets from Y to Z without problems} = 1 — p. 
Then 

P{A gets from X via Y to Z without problems} 

= P{A gets from X to Y} ■ P{A gets from Y to Z} = (1 - p) 2 . 

Obviously, when < p < 1, then (1 - p) 2 < (l - p 2 ) 2 . 

Example 5.8 Given a roulette, where the outcome of a single game is either red of probability p, or 
black of probability q = 1 — p. We assume that the games at the roulette are independent. 
We denote by X the stochastic variable which indicates the number of games in the first unchanged 
sequence of games. Thus, X = 3, if the sequence either is given by RRRB or BBBR. 

1) Find for each n € N the probability of X = n. 

2) Find the mean of the stochastic variable X. 

3) Find the minimum of the mean as a function of p. 
Is this result reasonable? 



1) Since {X = n} means that we either first have n reds and then one black, or first n blacks and 
then one red, we get 

P{X = n} = p n q + q n p = pq (p^ 1 + q"" 1 ) , n £ N. 

2) The mean value is computed in the usual way: 

e{x] = f;„p{x = „}= M f;(„ ! >-'+„,"-i) 

\q p J q p 

3) If we put x = - > 0, it follows that we shall minimize 

q 

E{X} = x+ -, x > 0. 

p 1 

The minimum is obtained for x = - = 1, corresponding to p = -. 
q 2 

The result is reasonable because we for p — - "often changes" between red and black. If e.g. 
p > -, then we shall get more reds in a row. 
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6 Binomial distribution 

Example 6.1 A coin is thrown 2?i times, where we assume that each of the 2 2n possibilities have the 
same probability 2~ 2n . 

1) Find the probability that we obtain heads precisely n times. 

2) Find the probability that we obtain heads precisely 2 times. 

3) Find the probability of obtaining heads at least 2 times. 



1) Wc apply the binomial distribution with p = q = -, so 

The n successes can be chosen in I I ways, each of probability 2~ 2n . 

2) Analogously 



P{X = 2} = 



' 2n \ 1 2n(2n-l) 1 _ n(2n - 1) 



2-» 



1 • 2 2 2 " 



92„ 
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3) Considering the complementary event we get 

p { x>2} = i-^=o}-p{x = i} = i-( 2 ;)-^-( 2 ;)-^ 



Example 6.2 Some airplane companies allow for that some of their passengers who have booked a 

ticket do not show up at take off. Therefore, the airplane companies possibly use to overbook. 

We assume in the following that each passenger has the probability of — for not showing up and that 

this happens independently of the other passengers. 

Company A always sells 10 tickets to its small airplane of 9 seats. 

Company B always sells 20 tickets to its larger airplane of 18 seats. 

Find the probability that company A at take off must reject one passenger. 

Find the probability that company B at take off must reject 1 or 2 passengers. 

Which one is the larger probability? 

Company A. We apply the binomial distribution, so 

P{k passengers appear} = ( fc J I — L • I — I , k = 0, 1, . . . , 10, 

9 
thus k successes and 10 — k failures, and the probability of success is — . Hence 

f 9 i 10 

P{A must reject} = P{10 passengers appear} = <^ — ^ = 0.3487. 
Company B. We again apply the binomial distribution with 

P{k passengers appear} = ( fc ) 1 10 | 1 10 j ' & = 0, 1, . . . , 20, 



P{B rejects} = P{20 passengers show up} + P{19 passengers show up} 

^9\ 20 nn (9\ 19 1 / 9 \ 19 f 9 20} /9\ 19 29 nnM „ 

Remark. If one company sells 100 tickets with only seats for 90, the probability of rejection is 
0.4513. 
If it sells 400 tickets with seats for 360, the probability of rejection is 
0.4756. 

We see that the larger the airplane, the higher the probability of rejection. It can be proved 
that if the company sells lOn tickets with only space for 9n, then the probability of rejection will 
ingly go towards - for n — > +oo. 
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Example 6.3 A person A fill in a row at random on a pools coupon, which means that for each of 

the 13 football games the probability is - for success. 

Find the probability for A obtaining 13 successes, and the probability for A obtaining precisely 12 

Another person B who knows more about football judges that he in each game has the probability - to 

guess right. 

Find the probability that B obtains 13 successes, and the probability that B gets precisely successes. 

2 
The expert in football C judges that she in each game has the probability of — for success. 

Find the probability that C obtains 13 successes, and the probability that C gets precisely 12 successes. 

This is an exercise in the binomial distribution, where N = 13. 

1 

1) The probability of s 



P A {13 successes} 

P A {12 successes} = ( ™ \ ■ jH • ? = J| = 0.0000163. 



2) The probability of 



P A {13 successes} = — = 0.000 244, 

P A {12 successes} = (n)-^ = ^ = ' 003 17 ' 



P A { 13 successes} = (-J =0.00514, 

P4{12 successes} = ( JjQ • j \ }" • \ = yQ)" = .0334 
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7 Lotto 

Example 7.1 In lotto, 7 numbers are drawn among 1,2,... ,36. A young hopeful, who wants to 
travel around the world, chooses 7 numbers on a lotto coupon. Find the probability that he gets all 7 
winning numbers, and find the probability that he gets 6 winning numbers. 

There arc in total 

( 3 7 6 ) =8 347680 

possible different lotto coupons. 
There is only 1 winning coupon, so 



The expected number of weeks, before this event occurs is 

= 8 347680 weeks « 160 532 years. 
Then we compute the number of possibilities of 6 winning numbers: 

1) The six winning numbers can be chosen in ) = 7 ways. 

2) The wrong number must be chosen among the remaining 36 — 7 = 29 numbers. This can be done 
I = 29 ways. 



(?)■ 



'(?)" 



fc = 0, 1, ... , 7, 



Po = 0.1870 Pl = 0.3983, p 2 = 0.2987, p 3 = 0.0996, 

p A = 0.0153, p 5 = 0.0010, p 6 = 0.000 024 32, p 7 = 0.000 000 12. 

We note that there are coupons with only 1 or 2 winning numbers in almost 70 % of all cases. 
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8 Huyghens' exercise 



Example 8.1 Two gamblers A and B throw by turns two dices. The game ends, when either A throws 

in total 6 (in which case A wins), or B throws in total 7 (in which case B wins B). If A is the first to 

throw, one shall find the probability that A wins, and also the probability that B wins. 

This exercise occurs in one of the very first books on the calculus of probability, written in 1656 by 

Huyghens. 





1 


2 


3 


4 


5 


G 


1 


2 


3 


4 


5 


G* 


7° 


2 


3 


4 


5 


G* 


7" 


8 


3 


4 


5 


G* 


7° 


8 


9 


4 


5 


G* 


7 V 


8 


9 


10 


5 


6* 


7° 


8 


9 


10 


11 


G 


7 


8 


9 


10 


11 


12 



It follows from the table that we have in total 6 • 6 = 36 possibilities. The table a 
these give the sum 6, and that 6 of them give the sum 7. This means that 



3 shows that 5 of 



P{Awinsinathrow}=p A = -, 

P{A does not win in a throw} = q^ = ^ 

1 
P{B wins in a throw} = pb = 7;, 

P{B does not win in a throw} = qs = - 
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The gamblers now throw by turns with A first. Then 

P{A wins in the 1st throw} = pa, 

P{B wins in the 2nd throw} = P{A does not win in the 1st throw}P{B wins in a throw} = qA- Pb, 

P{A wins in the 3rd throw} = (q A q B )PA, 

P{B wins in the 4th throw} = (q A qB) qA'PB, 

and then by induction, 

P{A wins in throw number 2n + 1} = (tote)" PA, n G N 

P{B wins in throw number 2n + 2} — (q^qs)" qA- Pb, n eN . 

Summing up we get 

+oo +oo 

P{A wins} = V P{A wins in throw number 2n + 1} = V (q A q B T PA = — 



1— |i - § 216-155 61' 

and 



P{B wins} = ^ P{B wins in throw number 2n + 2} = ^ (q A to)" <?A Pb = 



1 - <M <? 



1 — |i • | 216-155 61' 
As a check we see that the sum of the probabilities is 
30 31 ., 

6i + 6T = L 

Also note that even if A has the advantage of being first, his smaller probability 



s that B has a slightly larger probability of winning. 
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9 Balls in boxes 

Example 9.1 A box A contains 3 white balls and 1 black ball, and another box B contains 4 white 
balls. To the time 1 we draw at random 1 ball from each of the two boxes and interchange them. This 
interchanging is repeated at the times 2, 3, 4, 
Let p n denote the probability that the black ball is in A after n such interchangings. 



1) When n = 2, 3, . . . , it follows from the rule of total probability that 

p n = Pjblack in A at time n} 

= Pjblack in A | black at time n — 1} • Pjblack in A at time n — 1} 

+P{black in A | black in B at time n - 1} ■ Pjblack in B at tin 
3 1 M ill 

2) If n= 1, then 

number of whites in A 3 2 1 + 1 



number of balls ii 
If n = 2, then 



""4 ' 2^ "4 ' 2-2" " 23 ~ 23 ' 
Hence, the formula is true for n = 1 and for n = 2. 

Now, assume that the formula is true for some n £ N. Then 

2" + 1 2" + 2" + 1 2 n+1 + 1 



Pn+l = J + HPn=7 



- 2 «+2 ^ 2"+ 2 2"+ 2 2"+ 2 ' 

and the formula is also true for n + 1, and the claim follows by induction. 
3) Clearly, 

2" + l 1 1 1 

P "=^TT = 2 + 2^I^2 fOT "-°°' 

which one also intuitively would expect. 
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10 Conditional probabilities, Bayes's formula 

Example 10.1 A family has 3 children, of which it is given that at least one is a boy. Find the 

probability that all 3 children are boys. 

(We assume that boys and girls have the same probability of being born). 

There are in total 2 3 = 8 possibilities. In 7 of these there is at least 1 boy, and there is only one 
possibility that they are all three boys. Since the 7 events have the same probability, the searched 
probability is -. 

Remark 10.1 One frequently here sees Bayes's formula applied, in which case one obtains the wrong 
result -. The error is that one unconsciously assumes that (e.g.) the oldest child is a boy. 



Example 10.2 A (true) dice is thrown, until it for the first time shows a six. Find the conditional 
probability that the first six occurs in the 2nd throw, given that the first six occurs in a throw of even 
number. 



If the first six occurs in throw number 2n, then the first 2n — 1 throws cannot have given a six. Thus 
the probability is 

/5X 2 "" 1 i 

Pjfirst six in throw number 2n} = I - ) • - . 

\6J 6 

In particular, 

Pjlirsl six in throw number 2} = - ■ - = — . 
6 6 36 

Then we compute 

°° °° /5\ 2n_1 1 

Pjfirst six in an even throw} = ^_] -P{first six in throw number 2n} = ^J I - J • - 



5 1 



E 



x 2(„-l) 



6 6 ^iw 36 1_ i 36 n 

hence 

P{first six in throw number 2 | first six in an even throw} = — . 
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nd 6 black cards, 2 of thei 



Example 10.3 In a talon there are 6 red cards, 3 of them being a 
being aces. We draw one card at random from the talon. 

1) What is the probability that the drawn card is an ace, when we notice that it is red? 

2) What is the probability that it is a red card, when we observe that it is an ace? 



Red cards: ace ace ace 

Black cards: ace* ace* * 



1) There are 6 red cards, 3 of which are aces, so the probability is 



3 _ 1 

6 ~ 2' 



2) There 



i, 3 of which are red cards, so the probability is 
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Example 10.4 Three boxes A, B and C, contain red and black balls. Box A contains 2 red and 3 
black balls, box B contains 1 red and 4 black balls, and box C contains 3 red balls and 1 black ball. 
We choose randomly a box, and from this box we choose randomly one of the balls. Assume that the 
drawn ball is red. Find the probability that the ball comes from box A. 

Let o denote a red ball and * a black one. Then we get the following diagram, 



It follows that 

P(A) = P(B) = P(C) = \, 
and that 

P{ved\A}=^, P{ r cd\B}= ] } 
Then by Bayes's formula, 



P M |red } = - P(A).P {rcd \A } 



P{A) • P{red | A} + P{B) • P{red | B} + P{C) • P{rcd | C*} 

12 2 2 40 o 

3 " 5 = 5 = 5 = T _ ^ 

1 I 2 , 1 , 3 \ 3,3 27 97 27 ' 

3U+5 + IJ 5 + 4 20 Li Li 



Example 10.5 Two boxes A\ and A 2 contain w\ white and b\ black balls, and W2 white and bi black 
balls, resp.. We draw at random one ball from each one of the boxes, and then at random one of the 
two balls. 
Find the probability that this ball is white. 

Let Ai denote the event that a ball comes from box i, and let A denote the event that the ball is 
white. Since we choose 1 ball from each box, we get 

P(At) = \, i = 1, 2. 

Then by a simple counting, 

P(A\A l ) = -^-, * = 1, 2, 

hence by the law of total probability, 

P(A) = P(A 1 )P(A | A 1 ) + P(A 2 )P(A \A 2 ) = l -^- + \ -^—. 



Download free eBooks at bookboon.com 



Introduction to Probability 10. Comditional probabilities, Bayes's formula 

Example 10.6 An information channel can transmit 0s and Is, though some errors may occur. One 

expect that a sent is changed with the probability - to a 1, and that a sent 1 is changed with the 

1 2 5 

probability - to a 0. It is also given that in mean - of all signals are 0s. 

1) Assuming that we receive a 0, what is the probability that a was sent? 

2) Assuming that we receive a 1, what is the probability that a 1 was sent? 

We first write down Bayes's formula, 

P (A k ) ■ P (A \ A k ) 



P(A k \A) = 



~Y li P{A i )P{A\A i y 
i.e. A k and A "are interchanged" . 

1) Then we identify, 

A t = {i sent}, t = 0, 1, A = {0 received}. 

When this is put into Bayes's formula, we get 

. n P{0 sent} • P\0 received I sent} 

PiO sent D voce vor 1 = - - - - 

11 ; P{0 sent}P{0 received. | sent} + P{1 sent}P{0 received | 1 sent} 

2.4 _8_ « -„ 

- 3_^ _ 15 _ 90 _ f£ / Q1%) 

~ 2 4 i i ~ 8 1 ~ 53 - 53 l~ Ji/0 >- 

_ . 4 i 1 . 1 Aj 90 

3 5 3 6 15 18 

2) We here get by identification, 

A, L = {i sent}, i = 0, 1, A = {1 received}. 

Then by insertion, 

P{1 sent} • P{1 received | 1 sent} 



P{1 sent | 1 received} 



P{1 sent}P{l iv( oiwd | 1 sent} + P{0 scnt}P{l received | sent} 
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Example 10.7 A factory buys 1000 light bulbs of type A, and 500 bulbs of type B, which are somewhat 

more expensive. 

For a randomly chosen bulb of type A there is the probability 0.6 of that it lasts longer than 2 months. 

For a randomly chosen bulb of type B we have the probability 0.9 that it lasts longer than 2 months. 

By mistake all bulbs are mixed together. 

A bulb is chosen at random from the 1500 bulbs. Find the probability that this bulb will last for longer 

than 2 months. 

If a bulb lasts for more than 2 months, what is the probability that it is of type A ? 

It follows directly that 

P{the bulb lasts in more than 2 months} 

P{the bulb comes from A | the bulb lasts more than 2 months} 

Pjthc bulb comes from A} • P{the bulb lasts more than 2 months \ A} _ | ■ 0.6 _ 2 • 6 _ 4 
P{the bulb lasts in more than 2 months} 0.7 3-7 7 

(«0.57). 



Example 10.8 Given n slips of paper, each with one of the numbers 1,2,... , n. The n slips are 
randomly drawn one by one. Let k denote one of the numbers 2, 3, ... , n — 1. Given that the 
number on the slip of number k is bigger than all the numbers of the previously drawn slips, what is 
the probability that the number is the largest one (i.e. is n)? 

Let a k denote the number of the fc-th drawn slip. Then 

P{a k = n | o fc >oi, afc >o 2 , ..., Ofc >o fe _i} 

_ P{ak = n, a k > a x , a k > a 2 , . . . , a k > ak-i} _ P ' {ak = n} 

P{a k > a 1: a k > a 2 , ■■-, a k > a k _i\ P {a k > ai, a k > a 2 , ■ . ■ , a k > a fe _x}' 

Since we have the same probability for that the largest number occurs in the 1st draw as in the 2nd 
draw, ... , in the fc-th draw, we must have 

P{a k > ai, a k > o 2 , . . . , a k > a fc _i} = -. 

Since 

P{ 0jk = n}=i, 

hp finally get that 






' 1/jfc " 
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Example 10.9 One expects empirically in a collection of 1000 light bulbs the probability - that there 

are 0, 1, 2, 3, 4 or 5 defective bulbs. 

We choose from a given collection of 1000 bulbs a random test consisting of 100 bulbs. Find an 

approximate estimate of the probability that there are no defective bulbs in this sample. 

If we know that there are no defective bulbs in this random test, what is then the probability that there 

are no defective bulbs among the 1000 bulbs? 

Let Ak denote the event that there are k defective bulbs among the 1000, where k = 0, 1, 2, 3, 4, 5. 
According to the assumption. 



Let A be the event that there are no defective bulbs among the 100 bulbs. Then by the law of total 
probability, 



(i) p(A)=j2 p ( A ^ p ( A \ A ^=lib p ( A \ A ^ 
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a computation 






P(A\A ) = 


1, 




P{A\Ai) = 


999 998 901 900 9 

1000 ' 999 '"902 ' 901 ~ 10 


= 0.9 


P(A\A 2 ) = 


998 997 900 899 9 
1000 ' 999'" 902 ' 901 ~ 10 


899 


P(A\A 3 ) = 


^.p(A\A 2 ) = 0.7288, 




P{A\A A ) = 


^.P(A\A 3 ) = 0.6557, 




P(A\A 5 ) = 


^■P(A\A 4 ) = 0.5898, 





• P (A | A x ) = 0.8099, 



which by insertion into (1) gives 

P(A) = 0.7807. 
The question is answered by means of Bayes's formula, 

P(A )P(A\A [ 



P(A \A) = 



ELo P(Ak)P (A \A k ) 



P(Ap) 
' P(A) 
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11 Stochastic independency/dependency 

Example 11.1 A dice is independently thrown n times, where n > 3. Introduce for i < j the events 
Aij by 

Aij = {same numbers in the i-th and the j-th throw}. 

1) Compute PiAij). 

2) Prove that the events Aij, where 1 < i < j < n, are pairwise independent, though not independent. 



1) When the i-th throw has give the result m g {1,2,..., 6}, we have the probability - of obtaining 

6 
the same result m in the j-th throw, so 



2) Then consider the event A^ D Am, where i < j and k < £ . Clearly, if all four numbers are mutually 
different, then clearly 

P{A l3 nA u ) = P(A ij )-P(A ki ). 

If (i, j) ^ (k,£), while i, resp. j, is equal to one of the numbers k, £, the remaining two indices are 
still different, so given the number of the common index the probability is 

1 1 
= 6 ' 6 " 
This proves that the events are pairwise independent. 

Since n > 3, it suffices to consider the event A 12 n A 13 n A23. 

Given the result m in the 1st throw, we get the probability - for obtaining m in the 2nd throw, 

and the probability - for also to obtain m in the 3rd throw. Then the event A23 is automatically 

6 
fulfilled, so 

P (A 12 n A 13 n A 23 ) = P (A 12 n A 13 ) = P (A 12 ) ■ P (A 13 ) ^ P (A 12 ) ■ P (A 13 ) ■ P (A 23 ) , 
because P (A 23 ) = - ^ 1. 

D 

This shows that the events A^ are not independent. 
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Example 11.2 A coin is thrown n times, where n > 2. Each of the 2 n possible events are given the 
probability 2~ n . Let A denote the event that there in a series of n throws occur both heads and tails, 
and let B denote the event that we have at most one tail in the n throws. What can be said about the 
independency of A and B ? 



It follows that 



P{A) = 1 - P{all tails} - Pjall heads} = 1- — - — =l- ; 






1 



P(B) = Pjonc tail} + Pjall heads} = — + — = — -. 
The event A (1 B describes that there is precisely one tail, hence 

P(A n B) = Pjonc tail} = ^. 
This expression is equal to 

2 n_1 - 1 n + 1 

if and only if 

n+1 =2 n_1 , 

which happens if (and only if) n — 3. Hence we conclude that when i 
independent, and that A and B are not independent, if n > 2 and n^3. 



= 3, then A and B i 







i 
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12 Probabilities of events by set theory 

Example 12.1 Let A\, A 2 , ... , A n denote n events. Prove by induction the formula 

p({jAi\ = ^2p{Ai)~ J2 p ( A *i n A ^-)+ J2 p (4n4n4) + - 
+(-i) n - 1 p(A 1 n A 2 n ••• n A n ). 

For n = 1 wc get the trivial identity P(A 1 )=P(A 1 ). 
For n = 2 we get 

(2) P (A! U A 2 ) = P (A,) + P (A 2 ) - P (Ax n A 2 ) . 
It follows from 

P(A 1 UA 2 ) = P(A 1 \A 2 ) + P(A 2 \A 1 ) + P(A 1 nA 2 ) 

= {P (A 1 \A 2 ) + P (A 1 n A 2 )} + {P(A 2 \A 1 ) + P (A, n A 2 )} -P(A x n A 2 ) 

= P(A 1 ) + P(A 2 )-P(A 1 nA 2 ), 

that (2) holds. 

Then assume that the formula holds for some n e N. (It follows from the above that it is true for 
n — 1 and for n — 2). Consider n+1 sets. Then it follows from (2) that 

= P (U A A + P ( A n+l) P f U ^ n A "+ 1 >) 

= ^P(Aj)- Yj P(A il r\A i2 )+ J2 P(A n n A l2 n A t3 ) + --- 

= (-1)"-^ {A x n A 2 n • • • n A n ) + P (A n+1 ) 

-^p^n A n+l )+ J2 p ( A n n A '2 n A n+l ) 

- ^ p(A n n A l2 n A, 3 n A„ +1 ) 

H h (-i)"P (Ai n A 2 n • • ■ n A n n A„ + i) 

= ^P(Ai)- 5^ P(Ai n A i2 )+ Yl p (A n n A l2 n A l3 ) + ■ ■ ■ 

+(-i)"p (Ai n A 2 n • • • n A„+i) , 

which is the wanted formula with n replaced by n + 1. 
The formula then follows in general by induction. 
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Example 12.2 Let B\, B 2 , ... , B n denote n events. Prove the formula 

p ( H Bi ) = ^2 p ( R ^ ~ 12 p ( B 'i u B ^ + 5Z p ( B 'i u B ^ u B ^ + " ■ 

+ (-l) n - 1 P(B 1 U B 2 U ••• U B n ). 
Hint: The example can either be shown by induction, or one may use that 



i£j Vie J / 



for any index set, and then apply the result of Example 12.1. 

The proof by induction follows the same pattern as the proof of Example 12.1. so wc choose here 
the latter method, i.e. we assume that the result of Example 12.1 is known, Then 



n*) = p ( c {y cBi }) =i_p (y cA ) 

= i-JE^(^)-E p ( c ^ nCB 

+ J2 p {£ p n n Cb *2 n CB l3 ) + --- + (-i) n - 1 p(CB 1 n Cb 2 n ••• n Cs„) 1 

= l-h2P(LB l )-Y,P(^B ll UB l2 )) 

+ J2 P $( B n u B ^ U Bi 3 )) + ■■■ + (-l)"~ 1 P(C (Si U 5 2 U ■■■ U B n j) \ 

= i-fe{i-P(Bi)}- ^{l-p^uy 

+ 51 {l-P(B, 1 UB, 2 UB l3 )} + - + (-ir 1 (l-F(BiUB 2 U-.UB, l )) 
+ J^ P(S il U B l2 U B; 3 ) + • • ■ + (-^"-^(Bi U B 2 U ■ • • U B n ) 



n \ , I n 



Then the formula follows from 



'-(i) + (;)-(;) + - +i -§(?) i -' ( - i) '- (i - 1 )" 
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13 The rencontre problem and similar examples 

Example 13.1 The rencontre problem. 

In an airplane with n seats, n passengers - each provided with a numbered ticket - take at random 
their seats in the airplane. Find the probability p n that no passenger is sitting on the right seat, and 
find an approximate value of this probability. 

Hint: Let Af. denote the event that the k-th passenger sits on the right seat. Then 



- i - p (k4 



and we can apply the result of EXAMPLE 12.1. 

This example can be found in many variants. Another formulation is the hat problem: A sleepy 
cloakroom attendant distributes n hats between n gentlemen without bothering with whether the hats 
are in fact given to their owners; here p n is the probability that no one gets his own hat. 
Its original formulation (which deals with card playing) goes back to the French mathematician Mont- 
mort (1708). 

According to Example 12.1, 

"■■ - '-'EH 

- J2 P(A il nA i2 nA i3 ) + --- + (-i) n P{A 1 r\A 2 n---nA n ). 

Here, P (AA = -, and 

P (A t n AA = P (AA ■ P (A j \Ai) = -- —*— for i < j, 
n n—1 

and in general, 

P(Aii n A io n • • ■ n A iL ) = - ■ , for i x < «2 < • • ■ < ik- 

n n—1 n+l - k 

It follows that J2 t p ( A i) = 1> and 



I^n 4 )-(;)i-i.-i-i, 



md in general 

Y^ p {An n A l2 n • • • n A h 



I n (n-l)---(n + l-j) ' 
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because we choose j seats out of n possibilities in I . J ways. 

We get by insertion, 

1111 f_i)n 

—f > e" 1 ps 0.368 for n -> oo. 



For n = 
Then, 



1! 2! 3! 4! 
it is obvious that the probability is p\ = 0. 



P2 = 2> Ps = g, P4 = g = 0.375, p 5 = — w 0.367. 
Since p„ is a section of the alternating series 

■ (-i)" 



E 1 



where the absolute value of the rt-th term, 1/n!, is obtained by removing the alternating factor (—1)", 
and which decreases towards zero, the error of the truncated series is always smaller than the first 
rejected term, i.e. 
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Example 13.2 A box contains n slips of paper with the number 1 written on them, and to slips 
with the number 0, where n > to — 1. The n + to slips are drawn one by one without return. Find 
the probability that one never draws two slips with the number following each other. Indicate in 
particular the probabilities in the case ofm^A, n = 5 and m = 4. n — 8. 

We have in total to + n slips, corresponding to to + n positions. We can choose n among these (the 
position of the Is) in 



The successes are characterized by the fact that all zeros, with the exception of possibly the last one, 
arc followed by a 1: 

(01), (01), ...,(01), (0). 

In this way we "fix" m — 1 of the Is of the total number of n. The remaining 

must be distributed among n + 1 positions. (We have n of Is and a free to the right). This is 
equivalent to the placement of the to groups with aOonn + 1 positions, which can be done in 

( m + n\ 

[ TO J WayS ' 

We conclude that the probability that we never successively draw two slips with the same number 

"(-: 1 )/(-:-)■ 

We get for to = 4 and n — h. and for to = 4 and n — 8, 

(D/C)-* (:)/(?)-£ 

Example 13.3 In lotto, 7 winning numbers and 4 additional numbers are drawn among the numbers 
1, 2, 3, . . . , 36. It happens quite often that there amongst the 7 winning numbers are two or more 
neighbouring numbers, e.g. both 6 and 7 are winning numbers. 

1) Find the probability that there are no neighbouring numbers among the 4 additional numbers. 

2) Find the probability that there are no neighbouring numbers among the 7 winning numbers. 

3) Find the probability that there are no neighbouring numbers among the 11 drawn numbers. 
Hint: The example is related to the previous example. 

We assume in general that n < 18. Then we can draw n numbers among 36 in 

In the case where there are no neighbouring numbers in this sample, then we have two possibilities: 



(») 
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(a) The number 36 is not chosen, so the successor of each of the n numbers cannot be chosen. This 
gives n constraints, and we get 36 — n possibilities for the n places. We can choose n out of 36 — n 



(b) If 36 is chosen, then we are left with 35 places and n — 1 constraints, hence 35 — (n — 1) 
places for n — 1 pairs. We can choose n — 1 from 36 — n in 



ways 
Summarizing we get 



/ 36 - n \ 
\ n-1 J 

irizing we get 

( 36 r) + 0!:;'H 37 r) 

he probability is 

( 37 r)/( 3 „ 6 )- 

= 4, the 

(7), 



1) If n = 4, then the probability is 
' 36 \ 248 



2) If n = 7, then the probability is 

/ 30 \ // 36 \ 16965 

3) If n = 11, then the probability is 

( 3 V')/(")=t§St" 



Download free eBooks at bookboon.com 



Introduction to Probability 14. Strategy in games 



14 Strategy in games 



Example 14.1 Andrew has bought 3 unusual dices. Dice A has on its 6 surfaces the numbers 1, 6, 
11, 12, 13, 14, dice B has analogously the numbers 2, 3, 4, 15, 16, 17, and dice C has the numbers 5, 
7, 8, 9, 10, 18. All 3 dices are considered as true, i.e. be throwing any of the three dices each surface 

has the probability - for showing up. 

6 
Andrew suggest Peter to play a game with the following rules: They each choose one dice, throw it, 
and the one who gets the highest number is winning a prize. Peter is allowed first to choose among the 
3 dices, and afterwards Andrew can choose between the two remaining dices. This game is repeated 
12 times. Who has won most prizes? 

The example reminds very much of the well-known game of "stonc-paper-scissors" , so a qi 
guess is that Andrew will win most prizes, because he knows Peters strategy. We shall now prove this. 

We get by a computation that 

P{A>B} = (P{A=U} + P{A=13}+P{A=l2} + P{A=ll} + P{A = 6})x 
x (P{Y = 4} + P{Y = 3} + P{Y = 2}) 



P{B>C} = (P{B = 17} + P{B = 16} + P{B = 15}) x 

x(P{C=W} + P{C = 9}+P{C = 8} + P{C = 7}+P{C = 5}) 



P{C > A} = P{C = 18} • (P{A = 14} + P{A = 13} + P{A = 12} + 
+P{A = 11} + P{A = 6} + P{A = 1}) 
+(P{C = 10} + P{C = 9} + P{C = 8} + P{C = 7}) > 
x(P{A = 6} + P{^l=l}) 
+P{C = 5} • P{A = 1} 

15 5 



1 

6 


•6.I + 4. 


Ill 1 6+8+1 
6 6 6 6" 36 


Summing up we get 






P{A>B}=^, 


i.e. 


P{B>A} = L, 


P{B >C} = ^, 


i.e. 


P{C>B} = L, 


P{C>A}=^-, 


i.e. 


P{A >C} = L 



Hence, Andrew's strategy must be: 

1) If Peter chooses A, then Andrew chooses B. 

2) If Peter chooses B, then Andrew chooses C. 
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3) If Peter chooses C, then Andrew chooses A. 



In all three cases Andrew has the probability — of winning, so we may expect that he after 12 games 
has won 7 times. 
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15 Bertrand's paradox 



Example 15.1 A cord is drawn at random in a given circle. What is the probability p that the cord 
is longer than the side length of an inscribed equilateral triangle in the circle? 




Solution 1. One end point of the cord is denoted by A, while the other one is chosen randomly on 
the circle. If it lies on the smallest of the arcs BC , then the cord is longer then the side length of the 
equilateral triangle, hence p = - . 




Solution 2. The random cord is perpendicular so some diameter AD. The cord is longer than the 
side length of the equilateral triangle, if it cuts AD between E and F, hence p — - . 

Solution 3. The midpoint of the random cord is chosen anywhere in the open of the disc. Then the 
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cord is longer than the side length of the equilateral triangle, if the midpoint lies inside the inscribed 
circle of radius -, hence p = -. 

Explain this discrepancy. 

The example is known as Bertrand's paradox. 



In the lirst solution \ 



e the arc length on the circle divided by 2nr a 



In the second solution we use the length on AD, divided by the length of AD, as our probability 
measure. 



In the third soluti 
measure. 



se the area, divided by the area of the whole disc irr 2 , as our probability 
These three probability measures are clearly mutually different, explaining why we get different results. 
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